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P.  R.  Kumar 

1.  FOREWORD 

In  this  contract,  we  have  conducted  research  on,  and  obtained  several  important  results  in  the 
areas  of  adaptive  control,  filtering  and  signal  processing  and  global  optimizatoa 


4A.  STATEMENT  OF  THE  PROBLEM  STUDIED 


We  have  examined  three  major  problem  areas.  First,  we  have  analyzed  the  simulated  annealing 
algorithm  for  global  optimizatioa  Second,  we  have  studied  the  asymptotic  performance  of  several 
algorithms  for  adaptive  control  filtering  and  signal  processing.  Third,  we  have  studied  how  to  obtain 
robusmess  of  adaptation  algorithms  to  ever  present  unmodeled  dynamics  and  disturbances. 

4B.  SUMMARY  OF  THE  MOST  IMPORTANT  RESULTS 

Simulated  annealing  with  temperature  cooling  gives  rise  to  a  Markov  chain  with  time- 
inhomogeneous  transition  probablities.  We  developed  a  new  concept  of  “orders  of  recurrence,”  and 
created  a  new  theory  of  “balance  of  recurrence  orders'*  to  analyze  such  Markov  chains.  This  notion 
of  balance  is  completely  different  from  usual  balance,  which  equates  flux  in  and  out  of  every  spatial 
region  in  equilibrium.  Our  balance  theory  is  across  time,  not  space,  and  is  the  first  such  for  time- 
varying  processes.  As  a  consequence  of  this  theory,  we  have  deteraiined  the  necessary  and  sufficient 
condition  on  the  cooling  rate  in  order  for  simulated  annealing  to  hit  the  global  minimum  with  probabil¬ 
ity  one;  see  [1]. 

In  the  area  of  adaptive  control,  we  have  developed  the  first  convergence  analysis  of  any  stochas¬ 
tic  adaptive  controller  using  a  recursive  least  squares  parameter  estimator  in  Gaussian  noise,  an  open 
question  since  1973.  It  should  be  noted  that  recursive  least  squares  is  by  far  the  more  popular  choice 
in  comparison  with  gradient  based  schemes;  see  [2].  We  have  also  developed  a  performance  analysis 
for  pole-zero  placement  schemes,  and  generalized  certainty  equivalent  controllers. 

We  have  developed  a  comprehensive  theory  of  adaptation  for  parallel  model  schemes.  This 
includes  the  establishment  of  stability  and  optimality  of  output  error  identification  and  adaptive  HR 
filtering  algorithms,  an  open  question  for  more  than  a  decade.  We  have  proposed  new  algorithms  for 
adaptive  feedforward  control,  a  major  practical  application  area,  and  adaptive  active  noise  cancelling; 


see  [3].  For  the  latter  scheme,  the  university  has  applied  for  a  patent  We  believe  the  problem  of 
noise  control  is  a  major  growth  area  in  the  coming  decades. 

In  the  area  of  robustness  enhancement  and  analysis,  we  have  shown  that  by  simply  projecting  the 
parameter  estimates  onto  a  compact  convex  set,  we  can  obtain  robusmess  of  adaptive  algorithms  with 
respect  to  both  bounded  distuihances  as  well  as  small  unmodeled  dynamics;  see  [4],  Such  effects  are 
always  present  in  any  practical  application,  and  this  has  been  a  major  area  of  adaptive  systems  research 
for  the  past  nine  years.  Our  work  proving  that  such  a  simple  modification  gives  robusmess,  shows  that 
the  several  modifications  proposed  by  researchers  over  the  past  nine  years  are  unnecessary. 
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